Reducing crash risk for young drivers: Protocol for a pragmatic randomised controlled trial to improve young driver sleep.

Background: Road trauma is a leading cause of death and disability for young Australians (15-24 years). Young adults are overrepresented in crashes due to sleepiness, with two-thirds of their fatal crashes attributed to sleepy driving. This trial aims to examine the effectiveness of a sleep extension and education program for improved road safety in young adults. Methods: Young adults aged 18-24 years (n = 210) will be recruited for a pragmatic randomised controlled trial employing a placebo-controlled, parallel-groups design. The intervention group will undergo sleep extension and receive education on sleep, whereas the placebo control group will be provided with information about diet and nutrition. The primary outcomes of habitual sleep and on-road driving performance will be assessed via actigraphy and in-vehicle accelerometery. A range of secondary outcomes including driving behaviours (driving simulator), sleep (diaries and questionnaire) and socio-emotional measures will be assessed. Discussion: Sleep is a modifiable factor that may reduce the risk of sleepiness-related crashes. Modifying sleep behaviour could potentially help to reduce the risk of young driver sleepiness-related crashes. This randomised control trial will objectively assess the efficacy of implementing sleep behaviour manipulation and education on reducing crash risk in young adult drivers.

When tomorrow comes: A prospective risk assessment of a future artificial general intelligence-based uncrewed combat aerial vehicle system.

There are concerns that Artificial General Intelligence (AGI) could pose an existential threat to humanity; however, as AGI does not yet exist it is difficult to prospectively identify risks and develop requisite controls. We applied the Work Domain Analysis Broken Nodes (WDA-BN) and Event Analysis of Systemic Teamwork-Broken Links (EAST-BL) methods to identify potential risks in a future 'envisioned world' AGI-based uncrewed combat aerial vehicle system. The findings suggest five main categories of risk in this context: sub-optimal performance risks, goal alignment risks, super-intelligence risks, over-control risks, and enfeeblement risks. Two of these categories, goal alignment risks and super-intelligence risks, have not previously been encountered or dealt with in conventional safety management systems. Whereas most of the identified sub-optimal performance risks can be managed through existing defence design lifecycle processes, we propose that work is required to develop controls to manage the other risks identified. These include controls on AGI developers, controls within the AGI itself, and broader sociotechnical system controls.

Applying a systems thinking lens to anti-doping: A systematic review identifying the contributory factors to doping in sport.

The use of performance enhancing substances and methods (known as "doping") in sport is an intractable issue, with current anti-doping strategies predominantly focused on the personal responsibility and strict liability of individual athletes. This is despite an emerging understanding that athletes exist as part of a broader complex sports system that includes governance, policymakers, media, sponsors, clubs, team members, and athlete support staff, to name a few. As such, there is a need to examine the broader systemic factors that influence doping in sport. The aim of this systematic review was to identify and synthesise the factors contributing to doping and doping behaviours, attitudes, and beliefs and the extent to which this knowledge extends beyond the athlete to consider broader sports systems. The review followed PRISMA guidelines with risk of bias and study quality assessed by the Mixed Methods Appraisal Tool, and identified contributory factors synthesised and mapped onto a systems thinking-based framework. Overall, the included studies were determined to be of high quality. Support personnel, the coach, and the coach-athlete relationship represent key influences on the athletes' decisions to dope. From the evidence presented, doping is an emergent property of sport systems and represents a complex systemic problem that will require whole-of-system interventions. The implications for this and the focus of future research are discussed.

Testing the reliability of accident analysis methods: a comparison of AcciMap, STAMP-CAST and AcciNet.

Accident analysis methods are used to model the multifactorial cause of adverse incidents. Methods such as AcciMap, STAMP-CAST and recently AcciNet, are systemic approaches that support the identification of safety interventions across sociotechnical system levels. Despite their growing popularity, little is known about how reliable systems-based methods are when used to describe, model and classify contributory factors and relationships. Here, we conducted an intra-rater and inter-rater reliability assessment of AcciMap, STAMP-CAST and AcciNet using the Signal Detection Theory (SDT) paradigm. A total of 180 hours' worth of analyses across 360 comparisons were performed by 30 expert analysts. Findings revealed that all three methods produced a weak to moderate positive correlation coefficient, however the inter-rater reliability of STAMP-CAST was significantly higher compared to AcciMap and AcciNet. No statistically significant or practically meaningful differences were found between methods in the overall intra-rater reliability analyses. Implications and future research directions are discussed.

Practitioners who undertake accident analysis within their organisations should consider the use of STAMP-CAST due to the significantly higher inter-rater reliability findings obtained in this study compared to AcciMap and AcciNet, particularly if they tend to work alone and/or part of relatively small teams.

What Enables Child Sexual Abuse in Sport? A Systematic Review.

Sporting environments provide opportunities for perpetrators to commit child sexual abuse (CSA). While awareness of CSA in sport and preventative interventions are increasing, CSA in sport still occurs at alarming rates. A systematic review was conducted to identify and synthesize the extant literature on the enabling factors for CSA in sport. The 34 included articles were peer-reviewed and were primary sources; had full-text versions in English; included the individual, situational, environmental, or systemic antecedent factors and characteristics which enable CSA in organized sport (clubs, schools, universities, and representative teams); and focused on abuse in children (0-18 years old), and included retrospective incidents. The enabling factors from across the broader sports system were identified and mapped using a systems thinking-based approach, the Risk Management Framework (RMF) and the associated AcciMap method. The results indicated that enabling factors for CSA in sport were identified at multiple levels of the sporting system hierarchy. The results show that 24.1% (n = 46) of the enabling factors identified in the literature relate to the hierarchical level of the Athlete, teammates, opponents, and fans levels, and 52.9% (n = 101) of the enabling factors relate to the level of Direct supervisors, management, medical, and performance personnel level. However, only 13% (n = 25) of enabling factors to CSA in sport were identified at the combined top four hierarchical levels. Results indicate that the problem of CSA in sport is a systems issue, and future research is required to explore how these factors interact to enable CSA in sport.

Experience-based codesign approach to improve care in Australian emergency departments for complex consumer cohorts: the MyED project protocol, Stages 1.1-1.3.

INTRODUCTION: Emergency department (ED) care must adapt to meet current and future demands. In Australia, ED quality measures (eg, prolonged length of stay, re-presentations or patient experience) are worse for older adults with multiple comorbidities, people who have a disability, those who present with a mental health condition, Indigenous Australians, and those with a culturally and linguistically diverse (CALD) background. Strengthened ED performance relies on understanding the social and systemic barriers and preferences for care of these different cohorts, and identifying viable solutions that may result in sustained improvement by service providers. A collaborative 5-year project (MyED) aims to codesign, with ED users and providers, new or adapted models of care that improve ED performance, improve patient outcomes and improve patient experience for these five cohorts. METHODS AND ANALYSIS: Experience-based codesign using mixed methods, set in three hospitals in one health district in Australia. This protocol introduces the staged and incremental approach to the whole project, and details the first research elements: ethnographic observations at the ED care interface, interviews with providers and interviews with two patient cohorts-older adults and adults with a CALD background. We aim to sample a diverse range of participants, carefully tailoring recruitment and support. ETHICS AND DISSEMINATION: Ethics approval has been obtained from the Western Sydney Local Health District Human Research Ethics Committee (2022/PID02749-2022/ETH02447). Prior informed written consent will be obtained from all research participants. Findings from each stage of the project will be submitted for peer-reviewed publication. Project outputs will be disseminated for implementation more widely across New South Wales, Australia.

Identifying risk controls for future advanced brain-computer interfaces: A prospective risk assessment approach using work domain analysis.

Brain-computer interface (BCI) technologies are progressing rapidly and may eventually be implemented widely within society, yet their risks have arguably not yet been comprehensively identified, nor understood. This study analysed an anticipated invasive BCI system lifecycle to identify the individual, organisational, and societal risks associated with BCIs, and controls that could be used to mitigate or eliminate these risks. A BCI system lifecycle work domain analysis model was developed and validated with 10 subject matter experts. The model was subsequently used to undertake a systems thinking-based risk assessment approach to identify risks that could emerge when functions are either undertaken sub-optimally or not undertaken at all. Eighteen broad risk themes were identified that could negatively impact the BCI system lifecycle in a variety of unique ways, while a larger number of controls for these risks were also identified. The most concerning risks included inadequate regulation of BCI technologies and inadequate training of BCI stakeholders, such as users and clinicians. In addition to specifying a practical set of risk controls to inform BCI device design, manufacture, adoption, and utilisation, the results demonstrate the complexity involved in managing BCI risks and suggests that a system-wide coordinated response is required. Future research is required to evaluate the comprehensiveness of the identified risks and the practicality of implementing the risk controls.

From Anti-doping-I to Anti-doping-II: Toward a paradigm shift for doping prevention in sport.

Doping remains an intractable issue in sport and occurs in a complex and dynamic environment comprising interactions between individual, situational, and environmental factors. Anti-doping efforts have previously predominantly focused on athlete behaviours and sophisticated detection methods, however, doping issues remain. As such, there is merit in exploring an alternative approach. The aim of this study was to apply a systems thinking approach to model the current anti-doping system for four football codes in Australia, using the Systems Theoretic Accident Model and Processes (STAMP). The STAMP control structure was developed and validated by eighteen subject matter experts across a five-phase validation process. Within the developed model, education was identified as a prominent approach anti-doping authorities use to combat doping. Further, the model suggests that a majority of existing controls are reactive, and hence that there is potential to employ leading indicators to proactively prevent doping and that new incident reporting systems could be developed to capture such information. It is our contention that anti-doping research and practice should consider a shift away from the current reactive and reductionist approach of detection and enforcement to a proactive and systemic approach focused on leading indicators. This will provide anti-doping agencies a new lens to look at doping in sport.

Understanding complexity in a safety critical setting: A systems approach to medication administration.

'Medication errors' are a significant concern and are associated with a higher incidence of adverse events and unintentional patient harm than any other aspect of healthcare. While much research has focused on adverse medication errors, limited studies have specifically examined 'normal' medication delivery performance and the interactions between tasks, agents, and information within the medication administration system. This article describes a study that applied the Event Analysis of Systemic Teamwork (EAST) model to study the hospital medication administration system to identify opportunities to optimise performance and patient safety. Key findings of this study demonstrate that this is a highly complex system, comprising many social agents and a relatively closely linked series of tasks and information. However, most of the workload relies on a small proportion of healthcare professionals. Significantly, the patient has a minimal role in the medication administration system during their hospital stay. The research has shown that this approach enables mapping networks and their interdependencies to optimise the system as a whole rather than its parts in isolation.

Using systems thinking-based risk assessment methods to assess hazardous manual tasks: a comparison of Net-HARMS, EAST-BL, FRAM and STPA.

Formal risk assessment is a component of safety management relating to hazardous manual tasks (HMT). Systems thinking approaches are currently gaining interest for supporting safety management. Existing HMT risk assessment methods have been found to be limited in their ability to identify risks across the whole work system; however, systems thinking-based risk assessment (STBRA) methods were not designed for the HMT context and have not been tested in this area. The aim of this study was to compare the performance of four state-of-the-art STBRA methods: Net-HARMS, EAST-BL, FRAM and STPA to determine which would be most useful for identifying HMT risks. Each method was independently applied by one of four analysts to assess the risks associated with a hypothetical HMT system. The outcomes were assessed for alignment with a benchmark analysis. Using signal detection theory (SDT), overall STPA was found to be the best performing method having the highest hit rate, second lowest false alarm rate and highest Matthews Correlation Coefficient of the four methods.Practitioner summary: A comparison of four systems thinking risk assessment methods found that STPA had the highest level of agreement with the benchmark analysis and is the most suitable for practitioners to use to identify the risks associated with HMT systems.

Towards a unified model of accident causation: refining and validating the systems thinking safety tenets.

The systems thinking tenets were developed based on a synthesis of contemporary accident causation theory, models and approaches and encapsulate 15 features of complex systems that interact to create both safety and adverse events. Whilst initial testing provided supportive evidence, the tenets have not yet been subject to formal validation. This article presents the findings from a three-round Delphi study undertaken to refine and validate the tenets and assess their suitability for inclusion in a unified model of accident causation. Participants with expertise in accident causation and systems thinking provided feedback on the tenets and associated definitions until an acceptable level of consensus was achieved. The results reduced the original 15 tenets to 14 and 10 were identified as important to include in unified model of accident causation. The refined systems thinking tenets are presented along with future research directions designed to facilitate their use in safety practice.Practitioner summary: This article presents a refined and validated set of systems thinking tenets which describe features of complex systems that interact to create adverse events. The tenets can be used by practitioners to proactively identify safety leading indicators and contributory factors during adverse event analysis.

Understanding the systemic influences on maritime pilot decision-making.

Maritime incidents occurring during pilotage are of international concern. Maritime pilots control most pilotage operations worldwide, yet despite the safety criticality of their role, research examining pilot decision-making processes during these complex and dynamic operations is scarce. This article describes the findings from two studies that utilised an integrated systems thinking framework to understand how pilots make decisions and what factors are perceived to influence their decisions. Interviews were held with 22 pilots (Study 1) and 17 maritime safety stakeholders (Study 2) in the New Zealand maritime context. The findings illustrate the challenges pilots face during pilotage and provide insights into their decision-making processes and the systemic factors that can be addressed to improve maritime safety. Given the multiple causal pathways to incidents occurring during pilotage identified by this research, it is suggested that multiple systems-wide interventions are needed, which is likely to require a long-term, strategic approach.

A systems thinking approach to understanding youth active recreation.

BACKGROUND: Active recreation contributes to child and adolescent physical activity, however, factors affecting uptake are poorly understood at the systems level. The aims of this study were: (1) to use systems analysis methods to understand youth active recreation in Victoria, Australia, (ii) identify potential system leverage points to enhance active recreation, and (iii) explore stakeholder views of systems analysis methods for informing practice and policy decision-making. METHODS: Phase 1: Umbrella review of systematic reviews (2013-2018), synthesising evidence for correlates, determinants and intervention evidence for promoting active recreation. Phase 2: Development of three systems models (ActorMap and two ActivMaps), depicting active recreation actors/organisations, correlates, determinants and intervention evidence. Phase 3: Development of causal loop diagrams (CLDs) and identification of leverage points based on the Action Scales Model. Phase 4: Model feedback via stakeholder interviews (n = 23; 16 organisations). RESULTS: From the literature, 93 correlates and determinants, and 49 intervention strategies were associated with child and adolescent active recreation; the majority located at a social or individual level. Ten potential system leverage points were identified in the CLDs, which differed for pre-schoolers versus children and adolescents. Only time outdoors (an event leverage point) emerged for all age groups. Changes to the built and natural environment (i.e., land use planning, urban design) as a complete domain was a key structural leverage point for influencing active recreation in children and adolescents. Subject matter experts and stakeholder interviews identified 125 actors operating across seven hierarchical active recreation system levels in Victoria. Stakeholder interviews identified 12 areas for future consideration and recommendations for practice/policy influence. CONCLUSIONS: Our findings underscore the need for dynamic models of system behaviour in active recreation, and to capture stakeholder influence as more than a transactional role in evidence generation and use. Effective responses to youth inactivity require a network of interventions that target specific leverage points across the system. Our models illustrate areas that may have the greatest system-level impact, such as changes to the built and natural environment, and they provide a tool for policy, appraisal, advocacy, and decision-making within and outside of government.

Incident reporting in the outdoors: a systems-based analysis of injury, illness, and psychosocial incidents in led outdoor activities in Australia.

Incident reporting systems are a fundamental component of safety management, however, most systems used in practice are not aligned with contemporary accident causation models. This article presents an analysis of a National Incident Dataset (NID) for adverse incidents occurring in the Australian Led Outdoor Activity (LOA) sector. The aim was to investigate the adverse Injury, Illness, and Psychosocial incidents reported to the NID. In total, 1657 injuries, 532 illnesses, and 146 psychosocial incidents were analysed from 357,691 program participation days. The findings show that the rate of incidents per 1000 program participant days in LOAs was 4.6 for injury, 1.5 for illness, and 0.04 for psychosocial incidents, and incident severity was predominately minor. The analysis of systemic contributory factors demonstrates that incidents in LOA are systemic in nature, with multiple levels of the LOA system identified as contributing to adverse incidents. For example, contributory factors were identified across local government (facilities), schools (communication), parents (communication), LOA management (policies and procedures), people involved in the incidents (mental and physical condition), and the environment (terrain) and equipment (clothing). This study presents an assessment of the current state of safety in the Australian LOA sector and demonstrates the utility of applying systems ergonomics methods in practice. Practitioner summary: This article presents an analysis of 1657 injury, 532 illness, and 146 psychosocial incidents occurring in the Australian Led Outdoor Activity (LOA) sector, using a systems ergonomics method. The findings demonstrate the incident charactersitics and how decisions and actions from across the system contribute to adverse incidents in LOAs.

Distributed situation awareness: From awareness in individuals and teams to the awareness of technologies, sociotechnical systems, and societies.

A large component of Neville Stanton's work has focused on situation awareness in domains such as defence, transport, and process control. A significant contribution has been to initiate a shift from considering individual human operator situation awareness to considering the situation awareness of human and non-human teams, organisations, and even sociotechnical systems. Though controversial when introduced, the distributed situation awareness model has become increasingly relevant for modern day systems and problems. In this article we reflect on Stanton's contribution and point to a pressing need to consider a. The situation awareness of advanced technologies, and b. situation awareness at a sociotechnical system, societal and even global level. This is demonstrated via discussion on two contemporaneous issues: automated vehicles and the COVID-19 pandemic. It is concluded that, given advances such as artificial intelligence, the increased connectedness of society, emerging issues such as disinformation, and an increasing set of global threats, Stanton's distributed situation awareness model and associated analysis framework provide a useful toolkit for future Human Factors and Ergonomics applications.

Testing the reliability and validity of risk assessment methods in Human Factors and Ergonomics.

There is growing interest in the use of systems-based risk assessment methods in Human Factors and Ergonomics (HFE). The purpose of this study was to test the intra-rater reliability and criterion-referenced concurrent validity of three systems-based risk assessment approaches: (i) the Systems-Theoretic Process Analysis (STPA) method; (ii) the Event Analysis of Systemic Teamwork Broken Links (EAST-BL) method; and, (iii) the Network Hazard Analysis and Risk Management System (Net-HARMS) method. Reliability and validity measures were obtained using the Signal Detection Theory (SDT) paradigm. Whilst STPA identified the highest number of risks, the findings indicate a weak to moderate level of reliability and validity for STPA, EAST-BL and Net-HARMS. There were no statistically significant differences between the methods across analyses. The results suggest that there is merit to the continued use of systems-based risk assessment methods following a series of methodological extensions that aim to enhance the reliability and validity of future applications. Practitioner summary The three risk assessment methods produced weak to moderate levels of stability and accuracy regarding their capability to predict risks. There is a pressing need to further test the reliability and validity of safety methods in Human Factors and Ergonomics.

Using cognitive work analysis to identify competencies for human factors and ergonomics practitioners.

While several competency frameworks have been proposed for Human Factors and Ergonomics (HFE) practitioners, these are not commonly based on structured analyses. The aim of this research was to develop a sociotechnical systems model of the HFE practitioner role in Australia and identify the competencies required to fulfil the role. Study One applied the Work Domain Analysis phase of cognitive work analysis (CWA) to model the HFE practitioner role. Model refinement was undertaken with seven subject matter experts. In Study Two, the model was used to elicit the competencies (knowledge, skills, abilities, other characteristics) required for successful performance, via a survey of 28 HFE practitioners. Most competencies related to skills (i.e. communication skills) and knowledge (i.e. domain knowledge). Gaps in competencies were also identified, linked to a lack of HFE education pathways in Australia. The findings have practical utility for designing HFE practitioner roles and educational programs. Practitioner summary: Cognitive work analysis provided a structured analysis of the role of the Human Factors and Ergonomics (HFE) practitioner and to support the identification of competencies. The results suggest that HFE practitioners are generalists rather than specialists and have implications for the job design and education of HFE practitioners. Abbreviations: BCPE: board of certification in professional ergonomics; CIEHF: chartered institute of ergonomics and human factors; CWA: cognitive work analysis; HFE: human factors and ergonomics; HFESA: human factors and ergonomics society of Australia; IEA: International Ergonomics Association; KSAO: knowledge, skills, abilities and other characteristics; O*NET: occupation information network; SME: subject matter expert; SRK: skills, rules, knowledge; UK: United Kingdom; USA: United States of America; WDA: work domain analysis.

Clear and present danger? Applying ecological interface design to develop an aviation risk management interface.

Ecological Interface Design (EID) is a framework for developing dynamic interfaces that support operators to understand and take appropriate actions within highly-complex systems. This two-part study involved the development and evaluation of a novel EID-based static aviation risk management display. A within-subjects survey-based experiment employed measures of decision accuracy, situation awareness, user workload, usability, and user perceptions. Results from 23 participants showed that when compared to a risk interface utilised by a large aviation company, the EID display achieved higher usability and lower workload ratings with large effect sizes, with no differences in decision accuracy and situation awareness. The findings provide evidence that the EID framework can improve upon static traditional displays. Research contributions also include a novel model of an aviation ground operations system and an example application of EID to the development of a static display. Further research is necessary to identify the extent of the applications and benefits to static displays.

Evaluation of a systems ergonomics-based incident reporting system.

INTRODUCTION: Incident reporting and learning systems are a fundamental component of safety management. The purpose of this study was to evaluate a novel incident reporting system specific to the Australian Led Outdoor Activity (LOA) sector. The Understanding and Preventing Led Outdoor Accidents Data System (UPLOADS), is a recently introduced systems thinking-based incident reporting and learning system that utilises contemporary safety theory and methods. METHOD: The implementation of UPLOADS was evaluated using the RE-AIM framework based on the following dimensions: Reach, Efficacy, Adoption, Implementation, and Maintenance. A pragmatic evaluation approach was used in which evaluation data were collected through the triangulation of multiple sources including different LOA stakeholders from both the individual organisational level (LOA providers) and LOA sector governance level (LOA industry representatives), incident data collected through the UPLOADS National Incident Dataset, and the online and physical presence of UPLOADS. RESULTS: The findings show that a key strength of UPLOADS is its effectiveness as incident reporting tool for improving safety in the LOA sector. However, a weakness of UPLOADS is that it is not being implemented appropriately by the LOA providers. CONCLUSION: Overall, the current findings suggest that UPLOADS incident reporting tool is perceived by SMEs as an effective tool for improving safety in LOA. However, further work is required for UPLOADS to have a greater impact on the LOA sector. Specifically, Implementation of the UPLOADS system requires improvement, as well as additional training and education may be required to upskill and empower LOA providers to improve reporting and enhance the value placed on safety by LOA stakeholders. The RE-AIM framework was an appropriate evaluation framework for understanding the effectiveness of UPLOADS as a LOA sector specific incident reporting and learning system. PRACTICAL APPLICATIONS: The current findings have practical implications for ergonomics researchers applying evaluation frameworks in the real world, and LOA providers for implementing safety interventions. Lastly, contemporary systems-based incident reporting and learning systems have the capability to enhance the safety practices of the LOA sector.